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A METHOD AND CODING APPARATUS USING LOW 
DENSITY PARITY CHECK CODES FOR DATA 
STORAGE OR DATA TRANSMISSION 

5 CROSS-REFERENCE TO RELATED APPLICATION 

This application claims priority from U.S. Provisional Application No. 
60/296,223, filed June 6, 2001, and entitled "METHOD AND CODING USING 
LOW DENSITY PARITY CHECK CODES FOR DATA STORAGE OR DATA 
TRANSMISSION", AND U.S. Provisional Application No. 60/314,987, filed 
10 August 24, 2001, and entitled "A METHOD AND CODING MEANS USING 
ANTT-PASCH LDPC CODES". 

FIELD OF THE INVENTION 
The invention relates generally to data storage and/or communication 
systems. More particularly, the invention relates to the use of iterative soft and 
15 hard decoding of Low Density Parity Check Codes (LDPCs) for the improvement 
of bit error rates. 

BACKGROUND OF THE INVENTION 
Since its invention in the mid-sixties, the Viterbi algorithm (VA) has been a 
very efficient method for data detection in communication and storage systems. 

20 The Soft-Output Viterbi Algorithm (SOVA) is a modification of the VA that gives 
the most likely path sequence in the trellis as well as the "a posteriori" 
probability for each transmitted bit. Similar a posteriori probabilities (soft 
outputs) are also given by the BCJR (Bahl, Cocke, Jelinek and Raviv) algorithms 
which are widely known in the art. These algorithms, when combined with a soft 

25 decoding scheme for convolutional modulation codes, form efficient iterative 
"turbo" decoding schemes. Both SOVA and BCJR can be used in the Partial 
Response (PR) channels that exist in many communication and storage systems. 
Although the Bit Error Rates (BERs) of such schemes approach record low levels, 
the complexity of their implementation and the time delays involved pose 

30 serious problems. 
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It was discovered that in additive Gaussian noise channels the long 
Gallager codes can achieve near optimal performance. In the past few years 
several low density parity check codes (LDPCs) have been designed with 
performances very close to the theoretical limit. Also, a significant insight into 

5 iterative decoding has been gained due to interpretation of Message Passing 
Algorithm (MPA) in terms of belief propagation in graphical models. A graphical 
model that uses message passing terminology was introduced. Despite this 
tremendous progress, the code complexity issues were left aside. Although the 
considerations related to high capacity, speed and error performance are 

10 important, the complexity factors tend to dominate system architecture and 
design considerations, especially in extremely high speed applications such as 
magnetic recording. 

Iterative decoders proposed in the art have been of very high complexity, 
and are believed to be incapable of operating in the faster than lGbps regime~a 

15 speed common in current magnetic recording read channels. The high 
complexity of the proposed schemes is a direct consequence of the fact that, in 
random codes, a large amount of information is necessary to specify positions of 
the nonzero elements in a parity check matrix. The application of LDPCs in 
magnetic recording has been an active research area during the past several 

20 years. The results of several studies have been recently reported and several 
schemes based on random codes have been proposed. However, these schemes 
have not offered sufficient coding gains to justify the increase in 
encoder /decoder complexity which would be required. 

A first difficulty in designing a code for magnetic recording is the fact that 

25 the code rate must be high (8/9 or higher), because it is practically impossible to 
compensate for a rate loss by any improved detection technique of reasonable 
complexity, especially at high recording densities. A second limiting factor is 
thermal asperities. A thermal asperity occurs when, for example, a read head hits 
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a dust particle on the disc. A Thermal asperity can produce a burst of errors 
having a length that cannot be corrected even by a very powerful code, in which 
case a sector read retry must be performed. 

A traditional method of coping with thermal asperities is to use a high rate 

5 error event detecting block code concatenated with the Reed-Solomon (RS) code. 
An alternative is to replace the RS code with the longer iteratively decodable 
code, but no results with realistic channel models have been reported so far. 

A method of overcoming the aforementioned problems would be a 
significant improvement in the art. 

10 SUMMARY OF THE INVENTION 

The present invention addresses the aforementioned problems by 
providing a novel method and apparatus for encoding digital information to be 
transmitted through a communication channel or recorded on a recording 
medium. The method preferably uses Kirkman codes for encoding user bits. The 

15 invention also provides a method and apparatus for decoding information 
transmitted through the communication channel or stored on a recording 
medium. 

A combinatorial construction of a class of high rate iteratively decodable 
codes using Balanced Incomplete Block Design (BIBD), in particular Steiner 

20 (v,3,l) -systems, is proposed. This construction gives parity check matrices with 
column weights of 3 and minimum girths of4, 6 and higher. These systems are 
constructed using cyclic difference families of Z K with vHimod6, v prime power. 
The complexity of these codes is extremely low and is basically determined by 
the size of a difference family that the block design is a based upon. A hardware 

25 efficient encoding algorithm that exploits a cyclic structure of the new codes has 
been also proposed. 

Groups other than Z w can also lead to a low complexity implementation. 
Different choices of groups may reduce the effect of propagation of error events 
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in MPA. The systematical solution of this problem involves searching over all 
non-isomorphic groups, and removing groups with fixed points since such 
groups support localized message passing (the equivalent effect is produced by a 
bad interleaver). On the other hand, the groups with smaE Pasch factors, i.e. a 
5 small number of 4 set blocks (bits) sharing 6 points (equations), should be 
favored since they prevent a local message passing. 

These and various other features as well as advantages which characterize 
embodiments of the present invention will be apparent upon reading of the 
following detailed description and review of the associated drawings. 
10 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a plan view of a disc drive in accordance with embodiments of 
the present invention. 

FIG. 2 is a block diagram illustrating a read channel architecture in which 
the embodiments of the present invention can be implemented. 
15 FIGS. 3-1 and 3-2 illustrate Equations and Pseudocode used to describe the 

present invention. 

FIGS. 3-3 and 3-4 illustrate Tables used to describe aspects of the present 
invention. 

FIG. 4 is a bipartite graph of a low density parity check (LDPC) code for a 
20 Kirkman (7,3,1) system. 

FIG. 5 is a graph plotting code length versus code rate for Steiner system 

codes. 

FIG. 6 is a diagrammatic depiction of a GF(6t+l) cyclic difference family. 
FIG. 7 is a diagrammatic illustration of the structure of a low density 
25 parity check matrix in accordance with some embodiments of the invention. 

FIG. 8 is a block diagram illustrating an encoder in accordance with some 
embodiments of the present invention. 
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FIG. 9 is a block diagram illustrating a first portion of the encoder shown 
in FIG. 8 in accordance with some embodiments of the present invention. 

FIG. 10 is a block diagram illustrating a parallel-serial encoder in 
accordance with some embodiments of the present invention. 

FIG. 11 is a parity check matrix for a Kirkman (13,3,1) system. 

FIG. 12 is a block diagram illustrating an encoder for a LDPC code with 
two base blocks. 

FIG. 13 is a block diagram illustrating an encoder for a LDPC code with 
three base blocks. 

FIG. 14 is a graph plotting bit error rates (BERs) of different Kirkman 
LDPC codes. 

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS 
The present invention includes well-structured low-density parity check 
codes, as well as a method and apparatus for their encoding and decoding. A 
parity check matrix of these codes is completely determined by a set of few 
parameters, and can lead to a very low complexity implementation. Although 
the bipartite graphs are quite useful tools for visualizing message-passing 
algorithms, they are not as convenient in code design. The construction described 
herein is purely combinatorial. The construction is simpler compared to prior art 
constructions, and is based on Balanced Incomplete Block Designs (BIBDs). More 
specifically, the codes of the present invention are based on Steiner triple systems 
and z v groups, where v is the number of the parity check equations describing 
the code. The BIBDs are constructed vising Netto's difference families and z v , 
where v is prime power, and show that the complexity of these codes is 
extremely low and is basically determined by the size of the difference family 
that a block design is based upon. A hardware efficient encoding algorithm that 
exploits the cyclic structure of the BIBD is also proposed. 
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In order to assess the performance of the proposed codes, a system has 
been considered in which soft information is extracted from the partial response 
channel using BCJR or SOVA operating on the channel trellis, and then passed 
forth and back from BCJR or SOVA to a message passing algorithm (MPA). The 

5 motivation for using this setting is to understand the potential of Steiner-type 
codes in a decoding scheme that has a relatively low implementation complexity 
in read channel chips operating at speeds above 1 Gbps. Although generic 
methods and apparatus were described in the literature for encoding and 
decoding any linear code, when applied to the proposed LDPC codes at the 

10 current level of VLSI technology, they cannot be implemented in hardware for 
the most efficient long codes. The methods and apparatus described herein 
overcome these limitations. 

FIG. 1 is a plan view of a disc drive 100 which includes a housing with a 
base 102 and a top cover 104 (sections of top cover 104 are removed for clarity). 

15 Disc drive 100 further includes a disc pack 106 which is mounted on a spindle 
motor (not shown). Disc pack 106 includes a plurality of individual discs 107 
which are mounted for co-rotation about central axis 108. Each disc 107 has an 
associated product head 112 which carries one or more read and write 
transducers (read and write heads) for communicating with disc surface 109. 

20 Each product head 112 is supported by a suspension 118 which is in turn 
attached to a track accessing arm 120 of an actuator assembly 122. Actuator 
assembly 122 is rotated about a shaft 126 by a voice coil motor 124, which is 
controlled by servo control circuitry, to move head 112 in an arcuate path 130 
between a disc inner diameter 132 and a disc outer diameter 134. 

25 Also shown in FIG. 1 is circuitry 128 which diagrammatically represents 

circuitry associated with the channel architecture used in processing signals to be 
written to or read from the disc or media surface. The position in which circuitry 
128 is located need not be as shown in FIG. 1, but instead, the position of circuitry 
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128 shown in FIG. 1 is provided as an example for discussion purposes. Further, 
disc drive 100 is intended to represent any of a variety of data storage devices in 
which the methods and apparatus of the present invention can be implemented. 
For example, in one embodiment, disc drive 100 is a magnetic disc drive utilizing 

5 perpendicular recording techniques and components. However, in other 
embodiments, disc drive 100 can be other types of magnetic disc drive, or can be 
other types of disc drive such as an optical disc drive, a magneto-optical disc 
drive, etc. The methods and apparatus disclosed herein can also be used in other 
data storage devices, for example in magnetic tape storage devices. Further still, 

10 the methods and apparatus of the present invention can be used in environments 
other than data storage systems. For instance, the methods and apparatus of the 
present invention can also be used in communication systems. The following 
discussion, though directed specifically to data storage systems at times, is 
intended to be applicable to all such uses of the present invention. 

15 FIG. 2 is a block diagram illustrating circuitry 128 used to implement the 

channel architecture in some embodiments of the invention in which a data head 
interacts with a recording media, for example in disc drives or other data storage 
systems. Although shown in FIG. 2 in the context of a data storage system, the 
low density parity check code generating systems and methods of the present 

20 invention are not limited to use in data storage apparatus, but instead can be 
used in other environments such as in communications systems. 

As shown in FIG. 2, the channel architecture can include a number of 
different encoding/ decoding circuits, each encoding or decoding data in 
different manners for different purposes. The various circuits shown in the 

25 blocks of FIG. 2 can be implemented as integrated circuits, discrete components, 
or suitably programmed processing circuitry. For discussion purposes, various 
blocks shown in FIG. 2 are referred to genetically as being circuitry. 
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As shown in FIG. 2, data bits of a message word to be recorded on the 
recording media 109 are provided to cyclic redundancy check (CRC) encoder 
circuit 202 and then to RS error correcting code (ECC) circuit 204. Cyclic 
redundancy check encoder circuit 202 encodes the data using coding techniques 

5 of the type which are well known in the art in order to minimize mis-correction 
of errors in the decoding process. Error correcting code circuit 204 introduces 
additional bits to the message data bits. The additional bits improve the ability of 
the system to recover the signal when the encoded signal has been corrupted by 
noise introduced by the recording channel. The order of CRC encoder circuit 202 

10 and ECC encoder circuit 204 is not limited to the specific arrangement illustrated 
in FIG. 2. Also, circuitry 128 shown in FIG. 2 includes a RS ECC decoder circuit 
218 and a CRC checker circuit 220 in order to decode and CRC check data read 
back from the media using heads 112. 

Within the inner sub-channel are run length limited (RLL) encoder 206 

15 and decoder 216, which are of the type well known in the art. Run length limited 
encoder 206 can, in other embodiments, be implemented before RS ECC encoder 
if desired. Similar repositioning of RLL decoder 216 would also occur in these 
other embodiments. Channel encoder circuitry 208 encodes the data with LDPC 
codes generated in accordance with the present invention which is described 

20 below in greater detail. Although shown in a particular location in FIG. 2, 
channel encoder circuitry 208 can be implemented prior to RLL encoder circuit 
206 in other embodiments. 

Precoder circuit 210 is optionally included in the inner sub-channel and 
can be used to implement a code of rate 1/1. Generally, precoder circuit 210 is 

25 used to eliminate catastrophic error events and/or to convert the data from 
binary to another format. Front-end and timing circuit 212 filters and converts an 
analog read back signal from the head into a digital signal, providing timing for 
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sampling of the read back signal. Detection scheme circuitry 214 converts the 
digital signal into a binary (i.e., l's and O's) signal. 
1. Theoretical Basis of ihe Method 

The balanced incomplete block design (BIBD) is a pair (V f B), where V is a 
5 v-set and B is a collection of b k -subsets of V, called blocks, such that each 
element of V is contained in exactly r blocks, and such that any 2 -subset of V is 
contained in exactly A blocks. Since bk=vr , and A(v-l) = r(*-l), the notation 
(v,A-U)-BIBD is used for a BIBD with v points, block size k, and index X. The 
BIBD with a block size of k = 3 is called the "Steiner triple system." A Steiner 
10 triple system with A=l is called the "Kirkman system/ 7 For example, the 
collection B = (B U B 2 B n ) of the blocks: 

B x ={0,1,3}, B 2 ={1,2,4}, B z ={2,3,5}, B A ={3,4,6}, B 5 ={0,4,5), B 6 ={1,5,6}, B 1 ={0,2,6}, 

is an example of the (7,3,1) Kirkman system with v = 7, and b-l . As defined 

herein, the point block incidence matrix of a pair (V,B) is a vxb matrix A = (a itj ), 

15 in which a itj =1 if the i-th element of V occurs in the j-th block of B , and a tJ =0 

otherwise. The point block incidence matrix A of the system in this example is 
shown in Equation (1) of FIG. 3-k 

Each block is incident with the same number k of points, and every point 
is incident with the same number r of blocks. If b=v and r = k , the BIBD is called 

20 symmetric. The concepts of a symmetric (v,/:, X) -BIBD with k>3 and a finite 
projective plane are equivalent. Considering points as parity check equations 
and blocks as bits in a linear block code, then A defines a parity check matrix H 
of a Gallager code. Gallager codes are known in the art. The row weight is r , the 
column weight is k , and the code rate is R = (b-rank{H))lb . 

25 The first column of matrix A corresponds to block Bi in that it represents 

that the first bit is "connected" to the zero check point, the first check point and 
the third checkpoint. The second through seventh columns of matrix A 
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correspond to blocks B2 through B7 in the example given above, with the 
numbers in each block indicating the checks to which the bit is connected. 

It has been shown that in Additive White Gaussian Noise (AWGN) 
channels long Gallager codes with random sparse parity check matrices (referred 

5 also as low density parity check codes) can achieve near-optimum Bit Error Rates 
(BERs) when decoded using iterative algorithms based on belief propagation in 
graphs. To visualize the decoding algorithm, the parity check matrix is 
represented as a bipartite graph with two kind of vertices, as is known in the art. 
An example of a bipartite graph for a Kirkman (7,34) system whose incidence 

10 matrix is given above, is shown in FIG 4. The first subset is comprised of bits 
(illustrated generally at 250 in FIG. 4), and the second one is a set of parity check 
equations or points (illustrated generally at 252 in FIG- 4). An edge between the 
bit and the check exists, if the bit is involved in the check. Note that in the 
bipartite graph shown in FIG. 4, there are three checks per bit as illustrated by the 

15 three connections between each bit and the available checks. Translated to the 
block design terminology, the two sets of vertices are V and B , and an edge 
between the point a and B f exists if a is in B ( . In other words, H is the point 
block incidence matrix A . 

Note that using a projective geometry to construct a code would result in 

20 an equivalent symmetric BIBD, Since for symmetric BIBDs the number of parity 
checks is equal to the number of bits (b=v), the code rate is very low (slightly 
above 1/2). Therefore, for high-rate applications, the projective geometry is not 
very useful. Since those of skill in the art are likely to be more familiar with the 
bipartite graph terminology, an attempt is made to emphasize the equivalence 

25 between the two in every step of a code design. 

Notice that it is desirable to have each bit "checked" in as many equations 
as possible, but because of the iterative nature of the decoding algorithm, the 
bipartite graph must not contain short cycles. In other words, the graph "girth" 
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(the length of the shortest cycle) must be large. These two requirements are 
contradictory, and the tradeoff is especially difficult when the goal is to construct 
a code that is both short and of a high-rate. The girth constraint is equivalent to 
the constraint that every /-element subset of V is contained in as few blocks as 
5 possible. If each ^-element subset is contained in exactly A blocks, the underlying 
design is known as a "t-design," An example of a 5-design is the extended 
ternary Golay code. However, the rates of codes based on t-designs (t>2)are 
quite low, and therefore the analysis is restricted to the 2-designs, i.e. BIBD, or 
more specifically to the designs with the index A = The A=i constraint means 

10 that no more than one block contains the same pair of points, or equivalently that 
there are no cycles of length four in a bipartite graph. It also equivalent to the 
constraint that no pair of columns of a parity check matrix contains two ones at 
the same positions. 

From the fact that r(k-l) = A(v-l), and that bk = vr, it follows that the code 

15 rate R is given by Equation (2) shown in FIG. 3-1. This Equation holds for general 
f-designs, t >l, as well. FIG. 5 plots the required code lengths b for a given code 
rate (R=(b-v)/b) for codes based on the BIBD(z;,2,l) and BIBD(z;,3,l) systems. In 
experiments, codes with k=3 have exhibited somewhat better error 
performance.. Also, the construction of maximum rate BIBD codes with fc=2 is 

20 trivial. 

From FIG. 5, it can be seen that the lengths of short cycle-free codes of 
rates R>0.9 must be 6>500. The cycle length distribution can be easily obtained 
from the incidence matrix. The "coupling" matrix C = (c /; ) is defined herein as 

C= A T A-diag(A T A) . The element c u gives the number of points (checks) that are 

25 shared by the blocks (bits) i and /. The element cf) of a C l , 1>1 gives the numbers 

of loops of length 1 in which each block (bit) ; is involved. The diag(C l ), I > 1, gives 

the "l-th level coupling profile/' The block i with cjff > 0 is referred as a "tightly 
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coupled." For (v / k / l)-BIBD designs, C= J-J, where I is the identity matrix, and J 
is the bxb all-one matrix. Since C is symmetric, the coupling profile is uniform. 

CODE DESIGN 

It has been shown in the above discussion that the concept of Steiner 
5 systems offers a tool for designing codes without short cycles. Since codes 
constructed in this way are structured, they can lend themselves to a low 
complexity implementation. In this section, a simple construction of Steiner 
systems is defined using difference families of Abelian groups. 

Let V be an additive Abelian group of order v . Then t k - element subsets 
10 of V , B l -{* Uw 6 u } t iifSf l form a {vjc\) "difference family" (DF) if every 
nonzero element of V can be represented exactly X ways as a difference of two 
elements lying in a same member of a family, i.e., occurs X times among the 
differences b^-b^, l<i<£, \<m y n<k. In a (fl,Jfc,I) DF, X is equal to one. The 
sets Bi are called "base blocks/' If Vis isomorphic with z v , a group of integers 
15 modulo v, then a fr,fc,l) DF is called a "cyclic difference family" (CDF). For 
example, the block B x ={04,3} is a base block of a (7,3,1) CDF. To illustrate this, one 
can create an array A = (A <(j ) of differences \ } =(Z> li -b Uj ) mod 7 as shown in 
Equation (3) in FIG. 3-1. 

For example, with Bi = {0,1,3} as defined above, the first row of Ai is 0,6,4. 
20 The first element, 0, is calculated as 0-0 = 0. The second element, 6, is calculated 
as 0-1 = -1 (which is 6 in modulo 7). The third element, 4, is calculated as 0-3 = -3 
(which is 4 in modulo 7). 

The second row of Ai is 1,0,5. The first element, 1, is calculated as 1-0 = 1. 
The second element, 0, is calculated as 1-1 = 0. The third element, 5, is calculated 
25 as 1-3 = -2 (which is 5 in modulo 7). 

The third row of Ai is 3,2,0. The first element, 3, is calculated as 3-0 = 3. 
The second element, 2, is calculated as 3-1 = 2. The third element, 0, is calculated 
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as 3-3 = 0. In the methods of the present invention, the array should be designed 
such that in any matrix (for example Ai), all non-zero elements must be unique 
(occur no more than once). 

As it can be seen in Equation (3), each nonzero element of 2 7 occurs only 
5 once in Aj . One can also think of the actions of this group as partitioning B into 
classes or orbits. A set of orbit representatives is a set of base blocks. Given base 
blocks, the blocks B Jt l£j&t 9 the orbit containing B } can be calculated as 

Bj ={b jA +g] where g goes over all the elements from V. A construction 

of BIBD is completed by creating orbits for all base blocks. For example, it can be 

10 easily verified (by creating the array A) that the blocks B x = {0,1,4} and 
B 2 = {0,2,7} are the base block of a (13,3,1) CDF of a group V = Z 13 . The two orbits 
are given in Table 1 shown in FIG. 3-3. 

If the number of difference families is t , thenumber of blocks in a BIBD is 
b = tv . The parity check matrix corresponding to the (13,3,1) BIBD in TABLE 1 is 

15 shown in FIG. 11. This matrix contains only the weight 3 columns. Of course, 
since the order of the group in our example is small, the code rate is low (R=l/ 2). 
The codes based on z v are particularly interesting because they are conceptually 
extremely simple and have the structure that can be easily implemented in 
hardware. Notice also that for a given constraint (v,k,X) the BIBD based 

20 construction maximizes the code rate as can be seen using Equation 2 in FIG 3-1. 
Code rate is independent of the underlying group as long as the base blocks 
belong to a CDF, so that no two orbits overlap. Other groups may possibly lead 
to similar or better codes, but they are not discussed further in this application. 
CONSTRUCTION OF CYCLIC DIFFERENCE FAMILIES 

25 It is straightforward to construct a BIBD design once CDF is known. 

However, finding CDF is a much more complicated problem and solved only for 
some values of v.Jk and X . In this section, construction of a CDF is described. In 
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order to keep the discussion simple, the Kirkman system difference families are 
used. These difference families were constructed by Netto more than a century 
ago. Netto's construction is applicable if v is a prime v s 1 (mod 6) . When v is a 
power of prime, then z v is a Galois field GF(v), and we can define a 
5 multiplicative group *¥ of the field. 

Let a) be a generator of the multiplicative group (a primitive element in 
GF(v)). Write v as v=6*+i, t>i, and for da divisor of v-l, denote by H> d the 
group of d-th powers of rain GF{6t+\), and by <o l V d the co-set of d-th powers of 
w\ Then, the set {coW \\<izt) defines the Kirkman (6t +1,3 J) difference family. 

10 Provided in this disclosure is an intuition behind this result, rather than the 
details of the proof. 

FIG. 6 depicts GF(6*+l). The group can be generated by a primitive 
element co 1 = 2 . The powers of g> are shown as points on a circle (labeled also by 
the integer values inside the circle). Since the order of a) is v~l=l2, co 12 =1. The 

15 groups of 2t = 4 powers of m x are shown as star like sets (or clock hands). Hie 
two 3-sets B x ={2,5,6} and B 2 ={4,10,12} are base blocks of a Kirkman (13,3,1) 
system. B 1 and B 2 are equally spaced around the circle and all other triplets can 
be obtained by adding {1,2,..., 12}, i.e., by rotating the stars (the hands) 
counterclockwise and reading off the elements covered by the hands. As an 

20 illustration the base blocks for some small primes are given in Table 2 illustrated 
in FIG. 3-3. 

Tables 3 and 4 shown in FIG. 3-4 give a list of base blocks for other high 
rate (R>9/10) Kirkman codes. They are constructed using CDF described above. 
Note than the rate of the longest code is yery high, R=0.962. Two or more DFs 
25 involving different groups of bits as BIBD blocks can be combined to create a 
code of length 4096. 
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2. Description offlte MeiJtod 

Encoding. As shown previously, a difference family completely describes the 
positions of nonzero elements in a parity check matrix. Given a (v,k,\) CDF, as / 
k- element subsets of z v/ with base blocks B t ={^, P ...,^}, l<i^t, the parity 
5 check matrix can be written in the form H = [H } H 2 ...H t ], where each sub-matrix is 
of the dimensions vxv. For Kirkman codes, rank{H t )^v for all \<i<t, and in 
general rank(Hi)<>v . Assuming that the codeword c is a column vector of length 
tv , and using the fact that He = 0 , we have the relationship of Equation (5) shown 
in FIG. 3-1. In Equation (5), m is a column vector consisting of (t-l)v data bits, 

10 and p is column vector consisting of v parity bits. The parity bits can be 
calculated from the expression shown in Equation (6) in FIG 3-1. 

Parsing the message vector into t-1 sub-vectors of the dimensions v, so 
that m= [m (1) m (2) ...m (M) ] T , Equation (6) becomes as shown in Equation (7) shown 
in FIG. 3-1. Equation (7) leads to a simple hardware implementation of the 

15 encoding process. Note first that the encoder can work independently on 
message vectors m (l) ,m (2) , ..„m (M) to compute the products ft =H i xm i0 . Each of 
these operations is a Matrix-Vector-Multiplication (MVM), and can be carried 
out in some embodiments of the invention by a unit called MVM1 of the decoder, 
which is discussed later in greater detail. The left-hand side of Equation 6 is now 

20 A + + -P • When the vector p is found, the parity bits are calculated as 
shown in Equation (8) shown in FIG. 3-1. This operation is also of the MVM type, 
and is carried out in an example embodiment by a unit called MVM2 in the 
encoder. 

There are different ways to implement the encoder using MVM1 and 
25 MVM2 units. Here, we describe some specific implementations of the encoder for 
the parity check matrix H constructed from cyclic sub-matrices Hi , l < i < t . In this 
case, within every sub-matrix H t each column hf is a cyclic shift of the previous 
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column, that is that hf =S{h%), where S is a cyclic shift operator and 2<jzv . 
The first column of ff.has the nonzero elements at the positions given by B,, and 
will be denoted by h » = (h a , h i>2 , , . FIG. 7 is a diagrammatic illustration of the 
structure of a parity check matrix H used to create the new LDPC codes in 
5 accordance with the invention. In the example illustrated in FIG. 7, a few of the 
twenty seven (t=27) base blocks or sub-matrixes H, are shown. Base block 302 
corresponds to sub-matrix H x of H, while base blocks 304 and 306 correspond to 
the H 2 and H„ sub-matrixes of H. Note mat within each of these base blocks 
or sub-matrixes, each column following the first column is cyclic (i.e., a shifted 

10 version of the first column). 

It is worthy of note that in a (v jc,l) CDF, when v is not a prime number, 
but is a prime power (i.e., xy, where x is a prime number), the columns of //, are 
not simple cyclic shifts of a previous column, but nevertheless they can be 
generated as consecutive states of a maximum-length shift register with a 

15 primitive polynomial P(x) . The root of this polynomial co is the generator of the 
multiplicative group in GF(y) used to generate difference set from a base block. 
When v is a prime, the polynomial is P(x)=i+ x v - t . 

FIG. 8 is a schematic block diagram of a serial type encoder 340 which is 
configured to implement methods of the present invention. Encoder 340 includes 

20 MVM1 unit 345 and MVM2 unit 360 as described above. MVMl unit 345 of 
encoder 340 includes read only memory ROM 350, shift register SRI (designated 
generally at 352), v AND gates 354, v EXCLUSIVE-OR gates 356, and memory 
register MR1 (designated generally at 358). Read only memory 350 stores base 
blocks H, of parity check matrix H. The base blocks are sequentially loaded into 

25 the shift register SRI used to generate columns of H. Shift register SRI is shown 
as individual blocks or storage locations designated hi® through h v ®. After 
loading ft« -0^.*^,, A Av ), the contents of this shift register SRI is cyclically 
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shifted v times to generate columns of the sub-matrix //,■ . When the column hf is 
formed in this shift register, the column is multiplied by the corresponding data 
bit m/ 0 using v AND gates 354, and added component-wise in EXCLUSIVE-OR 
gates 356 to the already accumulated value of p stored in the memory register 
5 MR1. Finally, the parity check bits are calculated by the multiplication, in the 
unit MVM2, of the p column stored in memory register MR1 and . This 
encoding process can be summarized by the pseudocode shown in FIG 3-2. 

While working on the sub-matrix H t , the unit MVM1 of encoder 340 
performs the following operations at each clock cycle: 
10 1) bit shift of a length v vector (to find the next column of H t ); 

2) v Boolean AND operations (multiplying message bit mf and hf); and 

3 ) v Boolean EXCLUSIVE-OR operations ( ft = p t +mf -A® ), 

The inverse of the matrix // f is pre-calculated and stored in unit MVM2. 
The inverse of a cyclic matrix is often also cyclic, which means that the memory 

15 required for storing HJ l is not v 2 , as might seem initially apparent. Instead, the 
memory required for storing HJ l is only v , because only one column of H~ x 
needs to be stored. The encoder complexity is therefore a linear function in v, the 
number of parity bits. 

Another implementation MVM1 unit or circuit 345 for cyclic sub-matrices 

20 Hi is shown in FIG. 9. In the MVM1 unit or circuit shown in FIG. 9, the feedback 
of the MVM1 units is defined by the first column of the current sub-matrix H u 
and is fixed while we feed in v data bits mj (i) sv . The first column of the 
sub-matrix H if designated hi,i through /z,> in FIG. 9, is multiplied by the 
corresponding data bit m/ 0 using v AND gates 380, and is again added 

25 component-wise in EXCLUSIVE-OR gates 382 to the already accumulated value 
of p stored in a memory register. 
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A parallel-serial type of encoder 400 in accordance with the invention is 
shown in FIG. 10. This implementation uses f-2 MVM1 units 405 with fixed 
feedback as was shown in FIG. 9. In this case, only a small number of the 
multipliers corresponding to the nonzero values of =(% 1 ^ f2 ,.^ v )) is left in 
each MVM unit, while others are deleted. The outputs of the MVM1 units 405 
are added using adder 410 to generate the value of p ( p 1 +p 2 + ...+ /J M = p ). The 
MVM2 unit 360 calculates the parity check bits p in the same manner discussed 
above. The following two specific cases clarify this simplification: 

Encoder based on the Kirkman (13,3,1) system: The parity-check matrix of 
a LDPC code has the column weight fc=3, or in other words each code bit has 
three orthogonal parities. The base blocks and the orbits of this system are listed 
in Table 1 shown in FIG. 3-3. The parity-check matrix H is given in Equation (9) 
shown in FIG. 11. The inverse matrix is a circulant with the first column 
h = (1,0,0,0,1,1,1,0,1,0,1,1,0). The other columns of are cyclic (down) shifts of the 
first column h. The complete block diagram of the corresponding encoder is 
shown in FIG. 12. 

Encoder 500 shown in FIG. 12 includes MVM1 unit 505 and MVM2 unit 
510. MVM1 unit 505 includes a shift register having thirteen storage bins 515 and 
multiple adders 520. The number of storage bins 515 corresponds to the number 
of elements in each column of matrix H illustrated in FIG. 11. The adders are 
positioned such that, after thirteen data bits are shifted into the register at input 
525, the data contained in the storage bins is equivalent to multiplication of the 
data bits by the first column of the first sub-matrix Hi (left hand side) of matrix H 
illustrated in FIG. 11. 

After the thirteen bits are shifted into the shift register of MVM1 unit 505, 
switch 530 is closed and the contents of the storage bins 515 are shifted into 
MVM2 unit 510. It is important to note that switch 530 is not necessarily 
indicative of a physical switch, but instead is indicative of a switching function 
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which isolates MVM1 unit 505 and MVM2 unit 510 until the appropriate time. 
MVM2 unit 510 includes a shift register also having thirteen storage bins 535 and 
multiple adders 540. The adders 540 are positioned such that, after bits are 
shifted into the register at input 545 from MVM1 unit 505, the data contained in 

5 the storage bins is equivalent to multiplication of the contents of the MVM1 shift 
register by the inverse of the first column of the second sub-matrix Ha (i.e., 
inverse of the right hand side) of matrix H illustrated in FIG. 11. The encoded 
data can then be retrieved from the shift register of MVM2 unit 510. 

Encoder based on the (v,2,l)-BIBD: The parity-check matrix of this LDPC 

10 code has a column weight fc=2, and therefore only two orthogonal parities control 
each code bit. For v=7, for example, one can use the base blocks {0,2}, {0,3} and 
{0,1}, which give the parity-check matrix H =[H l H 2 H 3 ], where Hi, H2 and H3 are 
as shown in Equation (10) in FIG. 3-2, Looking at the first H sub-matrix Hi, the 
"l's" in the zero position and in the second position of the first column 

15 correspond to the base block {0,2}. In the sub-matrix H2, the "IV in the zero 
position and in the third position correspond to the base block {0,3}. In the sub- 
matrix H3, the "l's" are in the zero position and in the first position of the first 
column, corresponding to base block {0,1}. In each sub-matrix, all columns are 
circular shifts of the first column. 

20 Since in the case of fc=2 the rows of H are always linearly dependent, for 

encoding purposes one can delete some number of rows and columns, and 
construct a new parity check matrix with independent rows. In this example, we 
delete all the last rows and the last column of HP) in Equation (10). Therefore, for 
calculation of six parity bits as described by Equations (5)-(8), we use the 

25 matrices shown in Equation (11) of FIG. 3-2. 

A block diagram of a complete parallel-serial encoder 600 for this example 
is shown in FIG. 13. With three base blocks of matrix H, the first two base blocks 
are implemented using two appropriately configured MVM1 units 605 and 610. 
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As was in the case in the preceding example, the MVM1 units 605 and 610 have 
shift registers in which the storage bins are separated by adders positioned to 
multiply the incoming data bits of first and second data blocks by the first 
column of the corresponding sub-matrixes or blocks Hi and H2, respectively. The 
contents of the shift registers of units MVM1 and MVM2 are then summed at 
adder 620 and shifted through unit MVM2 615 (via switch 625) to generate the 
parity bits. The unit MVM2 615 is configured to multiply the bit-wise 
summation of the contents of the MVM1 and MVM2 units by the inverse of the 
first column of the third sub-matrix H3. 

FIG. 9 is a plot illustrating the bit error rates (BER) of different Kirkman 
LDPC codes calculated in accordance with the present invention. 

In summary, the present invention includes a method of generating low 
density parity check codes for encoding data. In some embodiments, the method 
includes constructing a parity check matrix H having a balanced incomplete 
block design (BIBD) in which a plurality B-sets which define the matrix have no 
more than one intersection point. The method can also includes generating 
parity bits as a function of the constructed parity check matrix H. 

Constructing the parity check matrix can also include constructing the 
parity check matrix H such that, for each vxv sub-matrix of the parity check 
matrix H, v being the number of bits in each row and column of each sub-matrix, 
each column of the sub-matrix contains the same number of l's as all other 
columns of the sub-matrix. Further constructing the parity check matrix can 
include constructing the parity check matrix H such that, for each vxv sub-matrix 
of the parity check matrix H, each column after a first column is a circular shift of 
the first column. Also, the parity check matrix H is constructed such that each 
column of the matrix contains the same number of l's as all other columns of the 
matrix, and such that no pair of columns in the parity check matrix contains two 
l's at the same positions. 
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The BIBD of the parity check matrix H is a pair (V,£), where Visa v -set 
and B is a collection of b k -subsets of V , each* -subset defining a block, such 
that each element of Vis contained in exactly r blocks, and such that any 2- 
subset of V is contained in exactly A blocks. In some embodiments of the 
5 methods and apparatus of the present invention, A is equal to 1. A (v,£, A) -BIBD 
is a BIBD with v points, block size k , and index A, and in the present invention, 
constructing the parity check matrix can further include constructing the parity 
check matrix such that it has a (v,fc,l) -BIBD. For example the present invention 
includes embodiments in which the parity check matrix is constructed such that 

10 it has a has a (v,3,l)-BIBD 0 r a (v,2,l)-BIBD. Other values of k are also possible 
using the methods and apparatus disclosed herein. 

The parity check matrix includes t sub-matrices [H x i/ 2 ...#,]such that 
H tf 2 ...#,] , and wherein m is a column vector consisting of (f-l)v data bits. 
In some embodiments, generating the parity bits further includes generating a 

15 column vector p consisting of v parity bits using the relationship 

The present invention also includes an encoder 208, 400, 500, and/or 600 
for encoding message data with a low density parity check code. The encoder 
includes a first matrix vector multiplier (MVM) which receives* a v-bit set of 

20 message data and multiplies the v bit set of message data by a first column of a 
first sub-matrix of a low density parity check matrix H having a balanced 
incomplete block design (BIBD) in which multiple B-sets which define the matrix 
have no more than one intersection point, the first MVM producing a first MVM 
output as a function of the multiplication. The encoder also includes a second 

25 MVM 360, 510, and/or 615 which receives the first MVM output and generates 
parity bits by multiplying the first MVM output by the inverse of a first column 
of a last sub-matrix of the low density parity .check matrix H. 
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In some embodiments of the present invention, the first MVM includes 
multiple first MVM units 345, 405, 505, 605 and/or 610 or the like, each receiving 
a different v-bit set of message data and multiplying its corresponding received 
v-bit set of message data by a first column of a different one of a plurality of sub- 
5 matrices of the low density parity check matrix H. In these embodiments, the 
first MVM produces the first MVM output as a function of a combination of the 
multiplication results in each of the plurality of first MVM units. 

It is to be understood that even though numerous characteristics and 
advantages of various embodiments of the invention have been set forth in the 

10 foregoing description, together with details of the structure and function of 
various embodiments of the invention, this disclosure is illustrative only, and 
changes may be made in detail, especially in matters of structure and 
arrangement of parts within the principles of the present invention to the full 
extent indicated by the broad general meaning of the terms in which the 

15 appended claims are expressed. For example, the particular elements may vary 
depending on the particular application for the LDPC code generating method 
and circuit while maintaining substantially the same functionality without 
departing from the scope and spirit of the present invention. In addition, 
although the embodiments described herein are directed to LDPC code methods 

20 and circuits for disc drive data storage systems, it will be appreciated by those 
skilled in the art that the teachings of the present invention can be applied to 
other systems, like magnetic tape data storage systems, optical storage systems, 
and communication systems without departing from the scope and spirit of the 
present invention. 

25 
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WHAT IS CLAIMED IS : 

d. A method of generating low density parity check codes for encoding data, 
the method comprising: 

constructing a parity check matrix H having a balanced incomplete block 
design (BIBD) in which a plurality B-sets which define the matrix 
have no more than one intersection point; and 
generating parity bits as a function of the constructed parity check matrix 
H. 

2. The method of claim 1, wherein constructing the parity check matrix 
further comprises constructing the parity check matrix H such that, for each vxv 
sub-matrix (Hi, Hi,... Ht) of the parity check matrix H, v being the number of 
bits in each row and column of each sub-matrix, each column of the sub-matrix 
contains the same number of l's as all other columns of the sub-matrix. 

3. The method of claim 2, wherein constructing the parity check matrix 
further comprises constructing the parity check matrix H such that, for each vxv 
sub-matrix (Hi, H2, . . . Ht) of the parity check matrix H, each column after a first 
column is a circular shift of the first column. 

4. The method of claim 3, wherein constructing the parity check matrix 
further comprises constructing the parity check matrix H such that each column 
of the matrix contains the same number of l's as all other columns of the matrix. 

5. The method of claim 4, wherein constructing the parity check matrix 
further comprises constructing the parity check matrix H such that no pair of 
columns in the parity check matrix contains two l's at the same positions. 

6. The method of claim 5, wherein constructing the parity check matrix 
further comprises constructing the parity check matrix H such that the BIBD is a 
pair (V t B) , where V is a v -set and B is a collection of b k -subsets of V , eachfc - 
subset defining a block, such that each element of V is contained in exactly r 



;DOCID: <WO_0209997SA2 J. > 



WO 02/099976 



PCT/US02/06897 



-24- 

blocks, and such that any 2 -subset of V is contained in exactly X blocks, and 
wherein X is equal to 1. ♦ 

7. The method of claim 6, wherein a (v^,A)-BIBD is a BIBD with v points, 
block size k , and index X , and wherein constructing the parity check matrix 
further comprises constructing the parity check matrix such that it has a (v, £,1) - 
BIBD. 

8. The method of claim 6, wherein constructing the parity check matrix 
further comprises constructing the parity check matrix such that it is a has a 
(v,3,l)-BIBD. 

9. The method of claim 6, wherein constructing the parity check matrix 
further comprises constructing the parity check matrix such that it is a has a 
(v ,2,1) -BIBD. 

10. The method of claim 7, wherein the parity check matrix includes t sub- 
matrices [H } H 2 ...H t ]such that H = [tfj # 2 ...#,], and wherein m is a column 
vector consisting of (*-i)v data bits, generating the parity bits further comprising 
generating a column vector p consisting of v parity bits using the relationship 
LH l H 2 ...H t _ l ]xm = H t xp. 

11. An encoder (208, 400, 500, 600) for encoding message data with a low 
density parity check code, the encoder comprising: 

a first matrix vector multiplier (MVM) (345, 405, 505, 605, 610) which 

receives a v-bit set of message data and multiplies the v bit set of 
message data by a first column of a first sub-matrix of a low density 
parity check matrix H having a balanced incomplete block design 
(BIBD) in which a plurality B-sets which define the matrix have no 
more than one intersection point, the first MVM producing a first 
MVM output as a function of the multiplication; and 
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a second MVM (360, 510, 615) which receives Hie first MVM output and 
generates parity bits by multiplying the first MVM output by the 
inverse of a first column of a last sub-matrix of the low density 
parity check matrix H. 

12. The encoder of claim 12, wherein the first MVM comprises a plurality of 
first MVM units (345, 405, 505, 605, 610) each receiving a different v-bit set of 
message data and multiplying its corresponding received v-bit set of message 
data by a first column of a different one of a plurality of sub-matrices of the low 
density parity check matrix H, the first MVM producing the first MVM output as 
a function of a combination of the multiplication results in each of the plurality of 
first MVM units. 

13. The encoder of claim 11, wherein for each vxv sub-matrix of the parity 
check matrix H, v being the number of bits in each row and column of each sub- 
matrix, each column of the sub-matrix contains the same number of l's as all 
other columns of the sub-matrix. 

14. The encoder of claim 13, wherein for each vxv sub-matrix of the parity 
check matrix H, each column after a first column is a circular shift of the first 
column. 

15. The encoder of claim 14, wherein each column of the parity check matrix 
H contains the same number of l's as all other columns of the parity check 
matrix. 

16. The encoder of claim 15, wherein no pair of columns in the parity check 
matrix H contains two l's at the same positions. 

17. The encoder of claim 16, wherein the parity check matrix His a (v,fc,A)- 
BIBD, where a (v t fc,A)-BIBD is a BIBD with v points, block size k , and index X , 
and wherein index X is equal to one. 

18. An apparatus for encoding digital information with a low density parity 
check code, the apparatus comprising: 
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an input which receives a sequence of message bits; and 
means for generating parity bits as a function of the sequence of message 
bits and as a function of a parity check matrix H having a balanced 
incomplete block design (BIBD) in which a plurality B-sets which 
define the matrix H have no more than one intersection point. 
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TABLE 1 

THE ORBITS OF BASE BLOCKS {0,1,4} AND {0,2,7} IN A (13,3,1) BIBD 
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SOME SMALL PRIME POWER (v,3,1) CYCLIC DIFFERENCE FAMILIES 
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SOME "HIGH RATE" PRIME POWER KIRKMAN (v,3,1) CDFs 
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TABLE 4 

HIGH RATE KIRKMAN (v,3,1) CDF WITH A NUMBER OF BLOCKS 
(CODE LENGTH) SMALLER THAN A SECTOR SIZE 
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The bipartite graph of the LDPC code 
(example for the Kirkman (7,3,1) system) 
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Steiner System 

. Codes 




FIGS 



0.6 0.7 
Code Rate 



FIG..6 




5DOCIO: <WO_02099976A2_I_> 



WO 02/099976 



PCT/US02/06897 



+ 

10/15 



CO 
Q 
T3 
O 
O 

O 
Q. 

Q 
_J 

CD 
C 

CD 

o 

CD 



O 



■ 

c 

c 
cd 

c 

<1> 



CO 

1— 
CD 
ay 

3 



(2) 

E 
c 



O) 
c 
0) 

0) 

o 
o 

I 

c 



05 

E 
o 

0) 

o 

|r 

CL 



© O i-h <~< O ► o o o 
Or-*— * O i-l . o o o 



*h o *— < © © .©©»-* 

O i - * o o o . o »— * »— < 

— ♦ O © © © . r-H i-M © 



oo^oo . O O r-H 

©»-*©©»-< . © O 

© O ^ © O . O O «-h 

O © © ^ . O — i © 

»-<©©»-»© . »-H © © 



o o ^ © © . — * © © 

© ^ © © ^ . © © © 

© © -I © . © © — I 

© ^-r © O . © ^ © 

^ ~4 O © © . — i o o 



vo 
o 

CO 



J2 

o 
o 



CD 
CO 

ctf 



0) 
JO 

E 



O 

CO 



II 




o 

1 

e 
it 

c 

f 

CO 
CD 



CO 
CD 
i — 

c 
ctf 

E 



0) 
CL 

E 

i 



K 
I 



JSDOCID: <WO_02099976A2_I_> 



WO 02/099976 PCT/US02/06897 



+ 



11/15 




50OCID: <WO_02099976A2LL> 



WO 02/099976 



PCT/US02/06897 



+ 



400 



410 




12/15 

Parallel-serial LDPC encoder 
■405 



UnitMVMl: P ll) =H im 



(0 



data bits mf l) 



UnitMVMl: fi {2) =H 2 m 



(2) 




data bits m . (2) 



Unit MVMl: = H M w 



data, bits m . (, - ,) 



UnitMVM2: P =H~ 1 p 



parity bits 



^360 

F/G- 10 



Parity-check matrix for (13,3,1) Kirkman system 



1 o 

i i 

O 1 

0 o 

1 o 

O 1 

o o 

o o 

o o 

o o 

o o 

o o 

o o 



o o o 

0 o o 

1 o o 
X 1 o 
Oil 

0 O 1 

1 o o 
O 1 o 
O O 1 

o o o 

o o o 

o o o 

o o o 



o o o 

o o o 

o o o 

o o o 

0 o o 

1 o o 
1 1 o 
Oil 

0 O 1 

1 o o 
O 1 o 
o O 1 

o o o 



O 1 o 

o O 1 

o o o 

o o o 

o o o 

o o o 

o o o 

0 o o 

1 o o 
1 1 o 
Oil 

0 O 1 

1 o o 



O 1 

0 o 

1 o 
O 1 

o o 
o o 
o o 

O Oi 

o o 

o o 

0 o| 

1 o; 
1 1 



1 o 

0 1 

1 o 

O 1 

o o 

o o 

0 o 

1 o 
O 1 

o o 

o o 

o o 

o o 



o o o 

0 o o 

1 o o 

0 1 o 

1 O 1 
O 1 o 
o O 1 
o o o 
o o o 
loo 
O 1 o 
o O 1 
O O O 



O 1 

O o 

o o 

o o 

0 o 

1 o 

0 1 

1 o 
O 1 
O O 

o o 

0 o 

1 o 



0 o 

1 o 
O 1 

o o 

o o 

o o 

0 o 

1 o 

0 1 

1 o 
O 1 
O O 
O O 



O O 1 o 

o o O 1 

0 o o o 

1 o o o 
O 1 o o 
O O 1 o 
O O O 1 
O O O O 

0 O O O 

1 O O O 

0 1 O O 

1 O 1 O 
O 1 O 1 



(9) 



FIG.-11 



VSDOCJO: <WO_02099976A2_I_> 




3DOC10: <WO_02099976A2_L* 



WO 02/099976 



PCT/US02/06897 



+ 

14/15 




MSDOCID: <WO_02099976A2_ l_> 



WO 02/099976 



PCT/US02/06897 



15/15 



10 



BER of the different Kirkman LDPC codes 
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Kirkman 181: J=3, n=5430, R=.966 
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Example: Kirkman 163: J=3, m=163, t=27, n=mt=4401 



m 

i 



^ (57) Abstract: A mclhod of generating low density parity check codes for encoding data includes constructing a parity check ma- 
trix H from balanced incomplete block design (BIBD) in which a plurality B-sels which define the matrix have no more than one 
^ intersection poinL The parity bits are then generated as a function of the constructed parity check matrix H. 
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